Real-Time Micro Environmental Observation with Virtual Reality

In this paper, the observation technique on the miCTO environments with a real-time virtual reality camera system, whitch is constructed with a dynamic focusing lens and a smart vision sensor using the “depth from focus” criteria, has been discussed In the operation with a microscope, such as the micro-surgery, DNA operation and etc., the small depth of a focus makes bad controllability to actuate 3 0 micro objects with actuators. For example, i f the focus is on the object, the actuator could not be seen in the microscope. On the other hand, i f the focus is on the actuator, the object could not be observed. I n this sense, the image, which includes all image informations at each focus values, i.e. “all-in-focus image” is usefu l to actuate objects in micro environments. However, one drawback on the all-in-focus image is that there is no information about the depth of objects. Then, it is also important to reconstruct a micro 3 0 environment in real-time to actuate objects in the macro virtual environments. Important factors to realize real-time system with the “depth from focus” criteria, which can obtain the allin-focus image and micro 3 0 reconstruction, simultaneously, had been discussed. Finally, the real-time system is constructed by a dynamic focusing lens, which can change the focus in high frequency, and a smart vision system, which is capable in capturing and processing the image data in high speed with SIMD architecture.